Python Job: Databricks Technical Lead

Job added on

Location

Dublin - Ireland

Job type

Full-Time

Python Job Details

Role: Databricks Technical Lead
Job Type: Permanent
Location: Dublin- Hybrid

Ready to utilize your experience/skills in building databricks data analytics platform?
Are you passionate about working on bigdata projects in databricks platform?
Keen to join a company where you can expand your skills in databricks implementation?

Join us as a Databricks Technical Lead to make a meaningful impact in the enterprise Data and Analytics space!

Careers at TCS: It means more
TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in Ireland and worldwide. For you, it means more opportunity to make an impact that matters, through challenging projects which demand ambitious innovation.
  • Be part of an exciting team where you will be challenged every day.
  • Work closely with the range of teams within the business to bring products to life.
  • Work with customers and identify opportunities to support their strategy and improve their processes across functions.

The Role
As a Databricks Technical Lead, you will have an opportunity to build best in class data ingestion, processing, and consumption patterns for business users operational and analytical needs. Your workloads will include streaming, near-real-time, and batch processing using PySpark/Python on AWS cloud. By working on this project, you will gain the domain knowledge of large vehicle rental business area.
Key responsibilities:
  • Design and implement highly performant data ingestion pipelines from distributed systems using Apache Spark and Databricks.
  • Oversee the technical team and all projects they undertake.
  • Determine project requirements and developing work schedules for the team.
  • Coordinate with the Architects, Delivery Manager, and the Software Engineers.
  • Provide technical direction, mentoring and best practices to both onshore and offshore Teams.
  • Collaborate with the team to identify and fix technical problems.
  • With team and inspire them to reach their goals.
  • Communicate with the clients to ascertain their needs.
  • Connect with client team and business team to gather project requirement.
  • Provide desk side assistance to end users and deploying applications to end-user devices based on requests.
  • Keep up to date with industry trends and developments.

Your Profile
Key skills/knowledge/experience:
  • Highly proficient with Python, PySpark and PL/SQL.
  • Experience in building ETL / data warehouse transformation processes.
  • Strong experience with Big Data, Data analysis with excellent analytical and problem-solving abilities.
  • Experience in Big Data components such as PySpark SQL, Data frames, HIVE, Notebooks, Workflows, Job Clusters etc implemented using Data Bricks.
  • Hands-on experience on Cloud based environments - AWS preferred.
  • Experience in building pipelines in Databricks.
  • Understanding of Databricks-AWS integrations, Delta Lake on AWS S3.
  • Excellent technical, diagnostic, and troubleshooting skills.
  • Strong leadership and organizational abilities.
  • Ability to multitask and work under pressure.
  • Good leadership skills.
  • Highly motivated and willing to learn new technologies.
  • Effective communication and interpersonal skills
Good to have:
  • Any AWS Cloud or Bigdata certification.
  • Exposure to data architecture principles and practices.

Rewards & Benefits
TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care and life assurance with access to extensive training resources and discounts within the larger Tata network.

Diversity, Inclusion & Wellbeing
At TCS, we believe in building and sustaining a culture of equity and belonging where everyone can thrive. Our diversity motto is ‘Inclusion without Exception’.

We encourage applications from all sections of society. As an equal opportunity employer, we do not discriminate on grounds of race, religion or belief, ethnic or national origin, disability, age, sex, pregnancy and maternity, citizenship, marital, domestic or civil partnership status, sexual orientation, gender reassignment, gender identity, or any other basis as protected by applicable law.

TCS is committed to working with and providing reasonable accommodations to its employees and applicants for employment to ensure that individuals with disabilities enjoy equal access to all employment opportunities. If you are an applicant who needs an accommodation due to a disability to complete an employment application or during any phase of the hiring process, please contact us with the subject line: "Disability Accommodation Request".

Due to a high volume of applications, we will be unable to contact each applicant individually on the status of their application. If you have not received a direct response within 30 days, then it should be deemed unsuccessful on this occasion.
Join us and do more of what matters. Apply online now.